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A search for lepton-flavor and lepton-number violation in the decay of the tau lepton into one 
charged lepton and two charged hadrons is performed using 221.4 fb _1 of data collected at an e + e~ 
center-of-mass energy of 10.58 GeV with the BABAR detector at the PEP-II storage ring. In all 
14 decay modes considered, the observed data are compatible with background expectations, and 
upper limits are set in the range B(t -> thti) < (0.7 - 4.8) x 10" 7 at 90% confidence level. 

PACS numbers: 13.35.Dx, 14.60. Fg, 11.30.Hv, 11.30.Fs 



Lepton-flavor violation (LFV) involving charged lep- 
tons has never been observed, and there are stringent 
experimental limits from muon decays: B{[i —> ej) < 
1.2 x 10" 11 Q and B(fi -> eee) < 1.0 x 10" 12 @ at 
90% confidence level (CL). In tau decays, the most strin- 
gent limits on LFV are B(t — ► ^7) < 6.8 x 10 -8 and 
B(t -» lit) < (1 - 3) x 10- 7 at 90% CL 0,0. While for- 
bidden in the Standard Model (SM), many extensions to 
the SM predict enhanced LFV in tau decays with respect 
to muon decays with branching fractions from 10~ 10 up 
to the current experimental limits [5j. Observation of 
LFV in tau decays would be a clear signature of physics 
beyond the SM, while non-observation will provide fur- 
ther constraints on theoretical models. 

This paper presents the results of a search for lepton- 
flavor violation in the neutrinoless decays r~ — > £~h + h' 
where I represents an electron or muon and h represents 
a pion or kaon In addition, a search is also per- 
formed for the decays t~ — > l + h~h' which also vio- 
late lepton-number conservation. All possible lepton and 
hadron combinations consistent with charge conservation 
are considered, leading to 14 distinct decay modes as 
shown in TableQ] The best existing limits on the branch- 
ing fractions for these decay modes currently come from 
CLEO: (2 - 8) x 10~ 6 at 90% CL 0. 

The data used in this analysis were collected with the 
BABAR detector at the PEP-II asymmetric-energy e + e~ 
storage ring. The data sample consists of 221.4fb _1 
recorded at a luminosity-weighted center-of-mass energy 
\/s = 10.58 GeV. With an estimated cross section for 
tau pairs of a TT = (0.89 ± 0.02) nb @, this data sample 
contains over 390 million tau decays. 

Charged-particle (track) momenta are measured with a 
5-layer double-sided silicon vertex tracker and a 40-layer 
drift chamber inside a 1.5-T superconducting solcnoidal 
magnet. An electromagnetic calorimeter (EMC) consist- 
ing of 6580 CsI(Tl) crystals is used to identify electrons 
and photons, a ring-imaging Cherenkov detector (DIRC) 
and energy loss in the tracking system are used to iden- 
tify charged hadrons, and the instrumented magnetic flux 
return (IFR) is used to identify muons. Further details 
on the BABAR detector are found in Ref. Q . 

A Monte Carlo (MC) simulation of neutrinoless tau 
decays is used to study the performance of this analysis. 
Simulated t + t - events including higher-order radiative 
corrections are generated using the KK2f MC generator 
H , with one tau decaying to one lepton and two hadrons 
with a 3-body phase space distribution, while the second 



tau decay is simulated with TAUOLA |l£| according to 
measured rates |l l| . Final state radiative effects are sim- 
ulated for all decays using Photos [l2|. The detector 
response is simulated with GEANT 0] , and the simulated 
events are reconstructed in the same manner as data. 

Candidate signal events are required to have a 1-3 
topology where one tau decay yields one charged particle 
(1-prong), while the other tau decay yields three charged 
particles (3-prong). Four well reconstructed tracks are re- 
quired with zero net charge, originating from a common 
region consistent with rr production and decay. Pairs 
of oppositely charged tracks, likely to be from photon 
conversions in the detector material, are ignored if their 
e + e~ invariant mass is less than 30MeV/c 2 . The event is 
divided into hemispheres using the plane perpendicular 
to the thrust axis, calculated from the observed track mo- 
menta and EMC energy deposits, in the center-of-mass 
(CM) frame. One hemisphere must contain exactly one 
track while the other must contain exactly three. 

One of the charged particles found in the 3-prong hemi- 
sphere must be identified as either an electron or muon 
candidate. Electrons are identified using the ratio of ob- 
served EMC energy to track momentum (E/p), the shape 
of the shower in the EMC, and the ionization loss in the 
tracking system (dE/dx). Muons are identified by hits 
in the IFR and small energy deposits in the EMC. Each 
of the other two charged particles found in the 3-prong 
hemisphere must be identified as either a pion or a kaon, 
using information from the DIRC and dE/dx. 

After event topology and particle identification re- 
quirements, there are significant backgrounds from light 
quark qq production and SM rr events (without LFV) , as 
well as small contributions from Bhabha, and two- 

photon production of four charged particles. Additional 
selection criteria, largely the same for all 14 signal chan- 
nels, are applied as follows. No photon candidates, iden- 
tified as EMC energy deposits unassociated to a track, 
with B 7 > 100 MeV are allowed. This restriction removes 
qq backgrounds and SM tt events. The total transverse 
momentum of the event in the CM frame must be greater 
than 0.2 GeV/c, while the polar angle of the missing mo- 
mentum in the lab frame is required to be in the range 
[0.25,2.4] radians. These two requirements are effective 
at reducing two-photon and Bhabha backgrounds. The 
mass of the 1-prong hemisphere calculated from the four- 
momentum of the track in the 1-prong hemisphere and 
the missing momentum in the event, is required to be 
in the range [0.6,1.9] GeV/c 2 for ehh' candidates and 
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[0.8, 1.9] GeV/c 2 for \ihb! candidates. The 1-prong mass 
requirement is particularly effective at removing qq back- 
grounds as well as the remaining two-photon contribu- 
tion. To reduce Bhabha backgrounds, the momentum of 
the 1-prong track in the CM frame is required to be less 
than 4.5 GeV/c for the enir candidates. In addition, par- 
ticle identification vetoes are applied to specific selection 
channels. For all decay modes, lepton and pion candi- 
dates must not pass the kaon identification as well. For 
the ehh' decay modes, except for eKK, the 1-prong track 
must not be identified as an electron. This requirement 
is useful to reduce possible contamination from Bhabhas. 

To further reduce backgrounds, candidate signal events 
are required to have an invariant mass and total energy 
in the 3-prong hemisphere consistent with the neutri- 
noless decay of a tau lepton. These quantities are cal- 
culated from the observed track momenta assuming the 
corresponding lepton and hadron masses for each decay 
mode. The mass difference and energy difference are de- 
fined as AM = A/ rec - m T and AE = - E™ m , 
where M rec is the reconstructed 3-prong invariant mass, 
m T = 1.777 GeV/c 2 is the tau mass |lj E™ is the re- 
constructed 3-prong total energy in the CM frame, and 
£™ m is the CM beam energy. Rectangular signal re- 
gions are defined separately for each decay mode in the 
(AM, AE) plane. For the /ihh' modes, AM is required 
to be in the range [-20, +20] MeV/c 2 , while for the ehh' 
modes the range is [—30, +20] MeV/c 2 to account for ra- 
diative losses. For all 14 decay modes, AE must be in 
the range [-100, +50] MeV. 

These signal region boundaries are optimized to pro- 
vide the smallest expected upper limits on the branch- 
ing fractions in the background-only hypothesis. These 
expected upper limits are estimated using only MC sim- 
ulations, not candidate events in data. To avoid bias, a 
blind analysis procedure was adopted with the number of 
data events in the signal region remaining unknown un- 
til the selection criteria were finalized and all systematic 
studies had been performed. Fig. ^ shows the observed 
data for all 14 selection channels, along with the signal 
region boundaries and the expected signal distributions. 

The dominant remaining backgrounds are low multi- 
plicity qq events and SM rr events. These background 
classes have unique distributions in the (AM, AE) plane: 
qq events populate the plane uniformly, while rr back- 
grounds are restricted to negative values of both AM and 
AE. Backgrounds from Bhabha, /i/z, and two-photon 
events are found to be negligible. For each background 
class, a probability density function (PDF) describing the 
shape of the background distribution in the (AM, AE) 
plane is determined by fitting an analytic function to the 
Monte Carlo prediction as described in more detail below. 
These PDFs are then combined with normalization coeffi- 
cients determined from an unbinned maximum likelihood 
fit to the observed data in the (AM, AE) plane in a side- 
band (SB) region. The resulting function describes the 



TABLE I: Efficiency estimates, the number of expected back- 
ground events (N^gd) in the signal region (with total uncer- 
tainties), the number of observed events (N b s ) in the signal 
region, and the 90% CL upper limit for each decay mode. 
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event rate observed in the SB region and is used to predict 
the expected background rate in the signal region. The 
SB region is defined as the rectangle, excluding the signal 
region, bounding AM in the range [— 0.7, +0.4] GeV/c 2 
for ehh' final states and [-0.4, +0.4] GeV/c 2 for [ihh! final 
states, while AE must be in the range [—0.7, +0.4] GeV. 
The PDF shape determinations and SB fits are performed 
separately for each of the 14 decay modes. 

For the qq backgrounds, a PDF is constructed from 
the product of two functions Pm' and Pe' , where the 
coordinates (AM', AE') have been rotated slightly from 
(AM, AE) to better fit the expected distributions. The 
function Pm'(AM') is a Gaussian and the function 
Pe'(AE') = (1 - x/Vl + x 2 ){l + aix + a 2 x 2 + a 3 x 3 ) 
where x = (AE' — 04) /as and at are fit parameters. The 
resulting qq PDF is described by eight fit parameters, 
including the rotation angle, which are determined by 
fits to MC qq background samples for each decay mode. 
For the rr PDF, the function Pm'(AM') is the sum of 
two Gaussians with different widths above and below the 
peak, while the functional form of Pe> (AE 1 ) is the same 
as the qq PDF above. To properly model the wedge- 
shaped kinematic limit in tau decays, a coordinate trans- 
formation of the form AM' = cos /3i AM + sin (3\AE and 
AE' = cos fiiAE— sin (32 AM is performed. In total there 
are 12 free parameters describing this PDF, and all are 
determined by fits to MC rr samples. 

With the shapes of the two background PDFs deter- 
mined, an unbinned maximum likelihood fit to the data 
in the SB region is used to find the expected rate of each 
background type in the signal region. Extensive MC 
studies show that these PDF functions adequately de- 
scribe the predicted background shapes near the signal 
regions. The accuracy of these predictions is verified by 
comparing to data in regions neighboring the signal re- 
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FIG. 1: Observed data shown as dots in the (AM, AE) plane and the boundaries of the signal region for each decay mode. 
The dark and light shading indicates contours containing 50% and 90% of the selected MC signal events, respectively. 



gion in the (AM, AE) plane where no signal is expected. 
Expected backgrounds are shown in Table [IJ and an ex- 
ample of the background prediction compared to the ob- 
served data is shown in Fig. [5] 
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FIG. 2: Data (points) and background expectation (solid 
line) are shown for the fj, + ir~Tv~ candidates displayed in 
Fig. Expected signal distributions for a branching frac- 
tion of 5 x 10~ 7 are also shown as the dashed curve. The 
vertical lines indicate the signal region. 

The efficiency of the selection for signal events is esti- 
mated with a MC simulation of neutrinoless tau decays. 
About 40% of the MC signal events pass the initial 1-3 
topology requirement, and 20% to 70% of these prese- 
lected events pass the particle identification (PID) crite- 
ria, depending upon the signal mode. The final efficiency 
for signal events to be found in the signal region after all 
requirements is shown in Table [I] for each decay mode 
and ranges from 2.1% to 3.8%. This efficiency includes 
the 85% branching fraction for 1-prong tau decays [llj . 

The PID selection efficiencies and misidentification 
rates are measured directly using tracks in kinematically- 
selected data control samples. These values are parame- 
terized as a function of particle momentum, charge, polar 
angle, and azimuthal angle in the laboratory frame. The 
lepton-identification criteria have been designed to give 



very low mis-identification rates at the expense of some 
efficiency loss. The electron ID is expected to be 81% effi- 
cient in signal ehh' events, with a mis- ID rate of 0.1% for 
pions and 0.2% for kaons in generic rr events. The muon 
ID is 44% efficient for fihh' signal events, with a mis-ID 
rate of 1.0% for pions and 0.4% for kaons. The hadronic 
identification is designed to classify the hadronic candi- 
dates as pions or kaons, but is not intended to distinguish 
hadrons from leptons. The pion ID is 92% efficient with 
a mis-ID rate of 12% for kaons, while the kaon ID is 81% 
efficient with a 1.4% mis-ID rate for pions. 

The largest systematic uncertainty for the signal effi- 
ciency is the uncertainty in measuring particle ID effi- 
ciencies. This uncertainty (all uncertainties quoted are 
relative) is dominated by the statistical precision of the 
PID control samples, and ranges from 0.7% for e~7r + 7r~ 
to 3.8% for fi~ K + K~ . The modeling of the tracking 
efficiency contributes an uncertainty of 2.5%, while the 
restriction on extra photons leads to an additional un- 
certainty of 2.4%. All other sources of uncertainty are 
found to be small, including the modeling of radiative ef- 
fects, track momentum resolution, trigger performance, 
observables used in the selection criteria, and knowledge 
of the tau 1-prong branching fractions. No uncertainty is 
assigned for possible model dependence of the signal de- 
cay. The selection efficiency is found to be uniform within 
20% across the Dalitz plane, provided the invariant mass 
for any pair of particles is less than 1.4 GeV/ c 2 . 

Since the background levels are extracted directly from 
the data, systematic uncertainties on the background 
estimation are directly related to the background nor- 
malization, parameterization, and the fit technique used. 
The finite data available in the SB region used to deter- 
mine the background rates dominates the background un- 
certainty. Additional uncertainties of 10% are estimated 
by varying the fit procedure and changing the functional 
form of the background PDFs. The uncertainty on the 
branching fraction of SM tau decays with one or two 
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kaons is also evaluated, and contributes less than 15% 
for all final states. 

The numbers of events observed (N b s ) and the back- 
ground expectations (N^gd) are shown in Table [IJ with 
no significant excess observed. Upper limits on the 
branching fractions are calculated according to B^ L — 
Nl° L /{2eha TT ), where Nff L is the 90% CL upper limit 
for the number of signal events when N b s events are 
observed with Nt> g d background events expected. The 
quantities e, L, and a TT are the selection efficiency, lumi- 
nosity, and t + t~ cross section, respectively. The branch- 
ing fraction upper limits are calculated including all un- 
certainties using the technique of Cousins and Highland 
[lfij following the implementation of Barlow The 
estimates of L and a TT are correlated ^3]; an d the un- 
certainty on the product La TT is 2.3%. The 90% CL up- 
per limits on the t — > £hh' branching fractions, shown in 
Table|U are in the range (0.7-4.8) x 10~ 7 . These limits 
represent an order of magnitude improvement over the 
previous experimental bounds |7j. 
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